Minimum Encoding Approaches for Predictive Modeling
نویسندگان
چکیده
We analyze differences between two information-theoretically motivated ap proaches to statistical inference and model selection: the Minimum Description Length (MDL) principle, and the Minimum Message Length (MML) principle. Based on this analysis, we present two revised versions of MML: a pointwise estimator which gives the MML-optimal single parameter model, and a volumewise estimator which gives the MML-optimal region in the parameter space. Our empirical results suggest that with small data sets, the MDL approach yields more accurate predictions than the MML estimators. The empirical results also demonstrate that the revised MML estimators introduced here perform better than the original MML estimator suggested by Wallace and Freeman.
منابع مشابه
Minimum Encoding Approaches for Predictive
We analyze diierences between two information-theoretically motivated approaches to statistical inference and model selection: the Minimum Description Length (MDL) principle, and the Minimum Message Length (MML) principle. Based on this analysis, we present two revised versions of MML: a pointwise estimator which gives the MML-optimal single parameter model, and a volumewise estimator which giv...
متن کاملEvaluating different scenarios for Tradable Green Certificates by game theory approaches
Right now employment of polices and tools to decrease the carbon emission through electricity generation from renewable resources is one of the most important problem in energy policy. Tradable Green Certificate (TGC) is an economics mechanism to support green power generation. Any country has the challenge to choose an appropriate policy and mechanism for design and implementation of TGC. The ...
متن کاملEncoding and Decoding Models in Cognitive Electrophysiology
Cognitive neuroscience has seen rapid growth in the size and complexity of data recorded from the human brain as well as in the computational tools available to analyze this data. This data explosion has resulted in an increased use of multivariate, model-based methods for asking neuroscience questions, allowing scientists to investigate multiple hypotheses with a single dataset, to use complex...
متن کاملPredictive PID Control of Non-Minimum Phase Systems
Control engineers have been aware of non-minimum phase systems showing either undershoot or time-delay characteristics for some considerable time (Linoya & Altpeter, 1962; Mita & Yoshida, 1981; Vidyasagar, 1986; Waller & Nygardas, 1975). A number of researchers that addressed this problem from a predictive control point of view mainly followed one of two approaches: a classical (non-optimal) pr...
متن کاملAdaptive Tuning of Model Predictive Control Parameters based on Analytical Results
In dealing with model predictive controllers (MPC), controller tuning is a key design step. Various tuning methods are proposed in the literature which can be categorized as heuristic, numerical and analytical methods. Among the available tuning methods, analytical approaches are more interesting and useful. This paper is based on a proposed analytical MPC tuning approach for plants can be appr...
متن کامل